 AD~A052 490 ARINC RESEARCH CORP ANNAPOLIS MD F/6 1/3 


ECP TREND ANALYSIS. (U) 
DEC 72 R A SMITHe T C HENSLER N00019-73-C=-0080 


1100-01-1-1197 


UNCLASSIFIED 


a 28 (25 
ae 
=r uy te 
il 1) 2.“ ie 
= a 
-— 


MICROCOPY RESOLUTION TEST CHART 
NATIONAL BUREAU OF STANDARDS-1963-# 


a i i i i i i i a i ee i i Ek el i i rt Ee ee ee, 


ADAQS2490 


NC Fue copy 


FINAL REPORT 
ECP TREND ANALYSIS 


December 1972 


Prepared for : 
NAVAL AIR SYSTEMS COMMAND, PMA-240 
WASHINGTON, D.C. 
under Contract N00019-73-C-0080 


locument 
for public reléase and salo: iis 
, distribution is unlimited. 


INTC RESEARCH CORPORATION 


Prepared for 


Naval Air Systems Command, PMA-240 
Washing L) 


Approved by 
Kenneth E. Lyons 


ARINC Research Corporation 
a Subsidiary of Aeronautical Radio, Inc. 
2551 Riva Road 
Annapolis, yland 21401 


ner 


This docum-ai ccs baen¢ ~ od 
' for public release and salo; iis 
distribution is unlimited. 


Copyright © 1972 
ARINC Research Corporation 


Prepared under Contract 1100-01-1-1197 


which grants to the U.S. Government a license 
to use any material in this publication for 
Government purposes. 


Gr ie i hs 


This report presents the results of a study to determine if any relationships exist 
between logistics elements and Engineering Change Proposals (ECP). ECPs were analyzed 
and logistics impact was assessed. The costs associated with ECPs were also investigated. 
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CHAPTER ONE 


INTRODUCTION 


\ The purpose of this study; conducted for the Naval Air Systems Command, 
Headquarters, PMA-240,Gwas- to Gomplete a trend analysis of the impact of Engineering 
Change Proposals (ECPs) on Weapons Systems Logistic Support for the P-3 aircraft. This 
objective was accomplished by two distinct types of logistic-impact assessments of each 
ECP. The first was an evaluation of whether the ECP had minimum, average, or maximum 
impact on spares support, and the second was a determination of whether or not the ECP 
did create an impact in publications, training, or ground support equipment. 


This report presents a discussion of the approach followed in the study and the results 
obtained, a review of data sources, the type of data collected, and the decision rules used in 
determining impacts (Chapter Two). It also includes a description of the analysis conducted, 
a synopsis of the data received, and a presentation of final results (Chapter Three). 
Conclusions and recommendations resulting from the study are also presented (Chapter 
Four). A computer listing of the data used in the study is presented in the appendix to this 
report. 


CHAPTER TWO 
STUDY APPROACH 


The initial phase of the ECP trend analysis involved the specification of desired impact 
data and the identification of potential sources of these data. To complete the impact 
assessment effectively, it was decided that the following information would be required: 

* ECP number 

Lockheed submission date (month, year) 
Affected aircraft (P-3A/B/C or a combination of the three) 
Affected-system description 
Change Control Board number 
* Change Control Board date (month, year) 


* Change Control Board action (approved, disapproved, canceled, rescinded, or 
withdrawn) 


- Contract amendment date (month, year) 
* Type of engineering change (airframe, avionics, power plant, etc.) 
* Technical directive number 
* Technical directive date (month, year) 
Incorporation status (forward fit only, or retrofit and forward fit) 
* Estimated cost 
- Description of engineering change, including considerations of impact on 
** Spares 
* Publications 
~ Training 
* Ground support equipment 


With these data elements selected, potential sources of information were identified. The 
first such source located was a partial set of ECP records at PMA-240, not containing any 
documentation of ECPs prior to number 370. 


To document the earlier ECPs, the next data source investigated was a master log, 
prepared and maintained by the Lockheed-California Company, summarizing Lockheed- 
submitted ECPs. This record provided partial data on all Lockheed-submitted ECPs and 
provided invaluable information regarding the impact of the ECP on training and 
ground-support equipment; it also gave the Lockheed submittal date and retrofit 
information. However, the material was not adequate for a full evaluation of the 
logistic-system impacts on the elements of interest. 


In a further attempt to obtain complete data, ARINC Research requested and received a 
copy of the Aeronautical Technical Directive Index. By using this, we were able to develop a 
cross-reference index between technical directive number, engineering change numbers, and 
type of change (e.g., airframe, avionics). The final document, used primarily as a cross 
reference, was the P-3C Weapon System Configuration Status Accounting Report. By using 
this list, it was possible to complete a check of Change Control Board numbers, ECP 
numbers, and the equipment affected. 


With full utilization of the four data sources, it was still impossible to achieve complete 
data resolution. One type of data eliminated from the collection effort was the predicted 
cost of the ECP change. Only about one-quarter of the total ECPs contained an estimate of 
anticipated costs. 


From the available data base, and with the assistance of knowledgeable P-3 personnel, 
logistic-impact assessments were made according to the following rules: 


Impact on Spare Parts 
Minimum Impact. The ECP being reviewed results in no modification to existing 
sparing. It has no effect on the quantity of spares procured previously or on order. 
Average Impact. The ECP being reviewed results in a minor modification to existing 
spares-procurement policy. It does not require scrapping any portions of existing 
inventory. 
Maximum Impact. The ECP being reviewed results in a major modification to 
existing sparing policy. This modification can take one of the following forms: 
Requirement to scrap portions of existing inventory 
- A change in spares procurement, necessitating additional spares purchases 
A change in existing maintenance concept 
Impact on Training, Publications, and Ground-Support Equipment. In these three areas, the 
prime consideration was an evaluation of whether the ECP did or did not have an impact on 
the specified area. 


To facilitate quantitative analysis, the results of the data search and impact assessment 
were prepared for computer processing. The data cards and the computer program 
developed for these analyses are available upon request. 


CHAPTER THREE 


DATA ANALYSIS 


This chapter outlines the type of analysis conducted in the study and describes the 
results obtained. The basic analysis method was to create frequency distributions that 
summarized, by time periods, the number of Engineering Change Proposals submitted by 
Lockheed Aircraft Corporation. These frequency distributions were developed by means of 
a computer program designed to output the trend information for all possible combinations 
of aircraft types, alternative base dates (LAC submission, CCB date, contract amendment 
date), and the various types of engineering changes (avionics, airframe, power plant, etc.). 
Upon completion of the data bank, it was determined that the only date with sufficient 
coverage available was the Lockheed submission date. Therefore, all frequency distributions 
were developed with only the Lockheed submission date as the common base date. 


To acquire a general understanding of the magnitude of various types of engineering 
changes, the first computer runs were devoted to analyzing ECPs related to all P-3C aircraft 
and the following types of changes: 


Avionics Changes 
Data processing/display 
Communications 
Navigation 
Acoustic sensors 
Nonacoustic sensors 
Total avionics changes 
Airframe Changes 
Power-Plant Changes 
All Others 


Avionics armament 
Accessories 
Support equipment 
Aircrew systems 
Propellers 
Photographic 


Clothing and survival equipment 
Air-launched missile 
Target-control system 


The output of this initial analysis was a set of frequency distributions, one set per type 
of change, showing the following: 


* Cumulative number of relevant ECPs 
* Percentage of these ECPs having maximum spares impact 
* Percentage of these ECPs having average spares impact 
* Percentage of these ECPs having minimum spares impact 
* Percentage of these ECPs having publication impact 
Percentage of these ECPs having training impact 
* Percentage of these ECPs having ground-support equipment impact 


As a result of this initial investigation, it was determined that the available data were 
insufficient to permit separate consideration of the five categories of avionics, the 
power-plant changes, and the “all other” grouping. The next computer run was made to 
obtain a 15-year plot of total P-3 avionics and airframe changes. The results of these 
computer outputs showed no discernible trend over time of either total avionics or airframe 
changes. The next phase of the analysis was to split the total P-3 ECPs into two categories, 
P-3A/B and P-3C, and to determine the trend of total avionics and airframe changes for the 
two aircraft categories. This separation of the data — predicated on the knowledge that the 
P-3A and P-3C were nearly identical aircraft, while the P-3C was unique because of an 
almost complete change of avionics — created the opportunity to consider the impact of 
ECPs on two aircraft-development programs. 


The outputs of this computer run, portraying the P-3A/B and P-3C as two separate 
aircraft, produced some interesting results. Since the P-3A/B is a mature weapon system, it 
is possible to make some definite conclusions about the trend of its ECPs. The P-3C has not 
attained the same level of maturity. However, it is possible to make a limited comparison 
between the pattern of P-3C ECP submissions and that of the P-3A/B, but no complete 
comparison can be made. 


Table 1 shows, by date through 1970, the cumulative number of approved P-3A/B 
avionics and airframe ECPs submitted and the percentage of the final total represented by 
each entry. Table 2 lists the same data for approved P-3C avionic and airframe ECPs 
submitted. Figures 1 and 2 show the cumulative percentage of approved avionics and 
airframe ECPs for the P-3A/B and P-83C, respectively. The point at which the number of 
Lockheed-submitted ECPs levels off is near the end of 1966 (shown in Figure 1). This point 
has not yet been reached for the P-3C, as can be seen in Figure 2. Figures 3 and 4, 
respectively, depict the number of P-3A/B and P-3C approved airframe and avionics ECPs 
submitted per year. 


In addition to the leveling out of ECPs submitted on the P-3A/B, it was interesting to 
note, for both avionics and airframe ECPs, that as the aircraft system matured, there was an 
increase in the relative number of ECPs having maximum impact on spares. This 
phenomenon is probably due to the fact that the spare parts had already been purchased for 
the P-3A/B. However, the absolute percentage having maximum impact never exceeded 10 
percent for the P-3A/B, and the remainder of the submitted airframe and avionics ECPs 
were evenly split between average and minimum impact. 


The P-3C exhibited a similar trend, with less than 10 percent of the airframe ECPs 
having a maximum impact on spares support. However, the P-3C avionics ECPs with 
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Figure 2, CUMULATIVE PERCENTAGE OF ECPS SUBMITTED PER YEAR 
FOR THE P-3C 
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maximum impact reached 20 percent, possibly reflecting problems with the more advanced 
avionic subsystems. The remaining ECPs for both airframe and avionics were split evenly 
between average impact and minimum impact, as was the case in the P-3A/B. 


i Table 3 shows the percentage of ECPs that affect publications, training, and 
ground-support equipment (GSE) for the P-3A/B and P-3C aircraft combined. 


Table 3. ECP IMPACT (P-3A/B/C) 
Percentage of ECPs 
Having Impact 


Geo a 


Publications 


Training 
GSE 


| 
| 
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The information in Table 3 can be used to make estimates of future ECP submissions. 
For example, there would be a 0.40 to 0.44 probability that an airframe ECP would impact 
on training, and a 0.92 probability that it would impact on publications. 


This review of ECPs submitted showed that there is a definite leveling of ECP activity as 
the aircraft system matures. However, the analysis provided no insight into possible 
relationships between ECP costs, impact, and time. Therefore, the next step in the analysis 
was to investigate the possibility of such mathematical relationships. To accomplish this 
objective, we reviewed the raw data forms and tabulated all available estimated cost figures 
for all three aircraft types. The final cost analysis was hampered by the lack of 
estimated-cost data, with only 14 percent of all available avionics ECPs, and 31 percent of 
all airframe ECPs providing cost data. In an attempt to establish a correlation between costs, 
time, and impact, a multiple regression was conducted on the available cost data. This 
analysis showed that ECP cost could not be related to time and impact with good statistical 
correlation. 


The cost data for P-3A/B/C aircraft are summarized in Table 4, separated by avionics 
and airframe ECPs. The high and low cost values as well as the median and mean costs for all 
ECPs, where cost values were available, are shown. The “Data Availability” column shows 
the actual number of ECPs containing cost data related to the row heading, the percentage 
of those ECPs containing cost data related to the row heading, and the percentage of ECPs 


| 
| 
in the entire study containing cost data related to the row heading. A total of 199 avionics . 
ECPs and 289 airframe ECPs were reviewed for cost data. For avionics, 24 ECPs had 
publications cost data, which represented 89 percent of the 27 avionics ECPs containing 
cost data. These 24 ECPs represent 12 percent of the 199 total avionics ECPs reviewed for 
cost data. 
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Table 4. P-3A/B/C ECP COST SUMMARY 


jt (meee ee - [= 
ECPs with Data 
Element 
Publications 24 89 1,600 431,300 26,500 
Training 10 37 168 5 
Spares 13 48 320 ’ ® * 

6 22 420 324, 4 


Airframe 


113,580 15,183 
88,140 ‘ 7,645 
271,779 R 32,230 
8,559 


This phase of the study was limited because of the low percentages — 14 percent for 
avionics and 31 percent for airframe — of ECPs for which cost data were available. Because 
of the small sample size, the widely scattered values, and the lack of a distributional shape 
associated with these cost data, the median value would be the best statistical point estimate 
to use in estimating future ECP costs for similar weapons systems. 
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CHAPTER FOUR 


CONCLUSIONS AND RECOMMENDATIONS 


CONCLUSIONS 


On the basis of the P-3A/B ECP data, it appears that the number of ECPs submitted by 
the prime contractor approaches zero as the end of production is reached. 


The number of ECPs being submitted each year on the P-3C is still increasing, 
particularly for the avionic subsystems, possibly reflecting their complexity in comparison 
with the P-3A/B avionic subsystems. 


Other conclusions are as follows: 


‘ There appears to be no central location where complete ECP data are available. 

* Only a small percentage (10 percent) of ECPs submitted had maximum impact on 
spares support. 
A high percentage (90 percent) of ECPs submitted affected publications. 


RECOMMENDATIONS 


A study similar to this one should be conducted on an aircraft that has recently 
completed the production phase of its life cycle. This additional study should be used to 
verify the results of the P-3 ECP Trend Analysis and to permit these results to be extended 
to other aircraft types. 


A central repository of ECP data should be established and maintained within 
NAVAIR. As a minimum, this system should be established for the P-3C to continue the 
monitoring of ECPs initiated in this study. 
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APPENDIX 


ECP DATA 


The data used in this study are shown on the following pages of this appendix. The 
items listed are self-explanatory except for the columns entitled “Sup”, “Trng”’, “Pubs”, 
and “GSE”. These codes reflect the impact of the ECP on spare-parts support, training, 
publications, and ground-support equipment, respectively. The codes are explained in 
Chapter Two of this report. 
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